δ13C tracing of dissolved inorganic carbon sources in major world rivers

δ13C tracing of dissolved inorganic carbon sources in major world river

History of the Class of \u2774

Class history written by Thomas Spooner Jr. which would have been presented at a Class Day or Commencement for the graduating Class of 1874

The Sound of Sweetness on the Grand Union Canal

On 11th March 2015, the gallant Tom Spooner and brave Simon King struck a course northwest on the Grand Union Canal, exploiting the terrain and the psycho-social boundaries imposed upon them by the city. They have left this message in the hope that others may come and join them in a great urban gathering at the Twyford aqueduct to celebrate their autonomy. - Message in a bottl

Consensus Multiplicative Weights Update: Learning to Learn using Projector-based Game Signatures

Cheung and Piliouras (2020) recently showed that two variants of the Multiplicative Weights Update method - OMWU and MWU - display opposite convergence properties depending on whether the game is zero-sum or cooperative. Inspired by this work and the recent literature on learning to optimize for single functions, we introduce a new framework for learning last-iterate convergence to Nash Equilibria in games, where the update rule's coefficients (learning rates) along a trajectory are learnt by a reinforcement learning policy that is conditioned on the nature of the game: \textit{the game signature}. We construct the latter using a new decomposition of two-player games into eight components corresponding to commutative projection operators, generalizing and unifying recent game concepts studied in the literature. We compare the performance of various update rules when their coefficients are learnt, and show that the RL policy is able to exploit the game signature across a wide range of game types. In doing so, we introduce CMWU, a new algorithm that extends consensus optimization to the constrained case, has local convergence guarantees for zero-sum bimatrix games, and show that it enjoys competitive performance on both zero-sum games with constant coefficients and across a spectrum of games when its coefficients are learnt

Algorithmic Trading and Reinforcement Learning: Robust methodologies for AI in finance

The application of reinforcement learning (RL) to algorithmic trading is, in many ways, a perfect match. Trading is fundamentally a problem of making decisions under uncertainty, and reinforcement learning is a family of methods for solving such problems. Indeed, many researchers have explored this space and, for the most, validated RL, its ability to find effective solutions and its importance in studying the behaviour of agents in markets. In spite of this, many of the methods available today fail to meet expectations when evaluated in realistic environments. There are a number of reasons for this: partial observability, credit assignment and non-stationary dynamics. Unlike video games, the state and action spaces are often unstructured and unbounded, which poses challenges around knowledge representation and task invariance. As a final hurdle, traders also need RL to be able to handle risk-sensitive objectives with solid human interpretation to be used reliably in practice. All of these together make for an exceptionally challenging domain that poses fascinating questions about the efficacy of RL and the techniques one can use to address these issues. This dissertation makes several contributions towards two core themes that underlie the challenges mentioned above. The first, epistemic uncertainty, covers modelling challenges such as misspecification and robustness. The second relates to aleatoric risk and safety in the presence of intrinsic randomness. These will be studied in depth, for which we summarise, below, the key findings and insights developed during the course of the PhD. The first part of the thesis investigates the use of data and historical reconstruction as a platform for learning strategies in limit order book markets. The advantages and limitations of this class of model are explored and practical insights provided. It is demonstrated that these methods make minimal assumptions about the market's dynamics, but are restricted in terms of their ability to perform counterfactual simulations. Computational aspects of reconstruction are discussed, and a highly performant library provided for running experiments. The second chapter in this part of the thesis builds upon historical reconstruction by applying value-based RL methods to market making. We first propose an intuitive and effective reward function for both risk-neutral and risk-sensitive learning and justify it through variance analysis. Eligibility traces are shown to solve the credit assignment problem observed in past work, and a comparison of different state-of-the-art algorithms (each with different assumptions) is provided. We then propose a factored state representation which incorporates market microstructure and benefits from improved stability and asymptotic performance compared with benchmark algorithms from the literature. In the second part, we explore an alternative branch of modelling techniques based on explicit stochastic processes. Here, we focus on policy gradient methods, introducing a family of likelihoods functions that are effective in trading domains and studying their properties. Four key problem domains are introduced along with their solution concepts and baseline methods. In the second chapter of part two, we use adversarial reinforcement learning to derive epistemically robust strategies. The market making model of Avellaneda and Stoikov (2008) is recast as a zero-sum, two player game between the market maker, and the market. We study the theoretical properties of a one-shot projection, and empirically evaluate the dynamics of the full stochastic game. We show that the resulting algorithms are robust to discrepancies between train and test time price/execution dynamics, and that the resulting strategies dominate performance in all cases. The final results chapter addresses the intrinsic risk of trading and portfolio management by framing the problems explicitly as constrained Markov decision processes. A downside risk measure based on lower partial moments is proposed, and a tractable linear bound derived for application in temporal-difference learning. This proxy has a natural interpretation and favourable variance properties. An extension of previous work to use natural policy gradients is then explored. The value of these two techniques is demonstrated empirically for a multi-armed bandit and two trading scenarios. The results is a practical algorithm for learning downside risk-averse strategies

Parameterized temporal exploration problems

In this paper we study the fixed-parameter tractability of the problem of deciding whether a given temporal graph G admits a temporal walk that visits all vertices (temporal exploration) or, in some problem variants, a certain subset of the vertices. Formally, a temporal graph is a sequence G = hG1, . . . , GLi of graphs with V (Gt) = V (G) and E(Gt) ⊆ E(G) for all t ∈ [L] and some underlying graph G, and a temporal walk is a timerespecting sequence of edge-traversals. We consider both the strict variant, in which edges must be traversed in strictly increasing timesteps, and the non-strict variant, in which an arbitrary number of edges can be traversed in each timestep. For both variants, we give FPT algorithms for the problem of finding a temporal walk that visits a given set X of vertices, parameterized by |X|, and for the problem of finding a temporal walk that visits at least k distinct vertices in V (G), parameterized by k. We also show W[2]-hardness for a set version of the temporal exploration problem for both variants. For the non-strict variant, we give an FPT algorithm for the temporal exploration problem parameterized by the lifetime of the input graph, and we show that the temporal exploration problem can be solved in polynomial time if the graph in each timestep has at most two connected components

Bayesian optimisation of restriction zones for bluetongue control.

We investigate the restriction of animal movements as a method to control the spread of bluetongue, an infectious disease of livestock that is becoming increasingly prevalent due to the onset of climate change. We derive control policies for the UK that minimise the number of infected farms during an outbreak using Bayesian optimisation and a simulation-based model of BT. Two cases are presented: first, where the region of introduction is randomly selected from England and Wales to find a generalised strategy. This "national" model is shown to be just as effective at subduing the spread of bluetongue as the current strategy of the UK government. Our proposed controls are simpler to implement, affect fewer farms in the process and, in so doing, minimise the potential economic implications. Second, we consider policies that are tailored to the specific region in which the first infection was detected. Seven different regions in the UK were explored and improvements in efficiency from the use of specialised policies presented. As a consequence of the increasing temperatures associated with climate change, efficient control measures for vector-borne diseases such as this are expected to become increasingly important. Our work demonstrates the potential value of using Bayesian optimisation in developing cost-effective disease management strategies

Flacons à parfum et pots à onguent de l’épave du Casimir (1829) – Des témoignages rares de la faïencerie Robert Le Demandé (Sanvic au Havre, Seine-Maritime)

Cet article présente la typologie du flaconnage de parfumerie découvert dans l’épave du Casimir. Ce brick de commerce havrais fit naufrage le 27 avril 1829 sur la côte septentrionale d’Haïti (aujourd’hui située en République dominicaine). L’étude morphométrique des contenants, pots en faïence et flacons en verre, est enrichie de l’analyse vibrationnelle de ces derniers par spectroscopie infra-rouge (IRTF) et leur analyse chimique par la méthode PIXE (Particule Induced X-Ray Emission) afin de préciser leurs compositions. Les résultats sont utilisés pour rechercher le fabricant de ces flacons et tenter d’identifier les initiales « D.R. » présentes sur presque tous ces récipients. Entre 1825 et 1829, seule la faïencerie Robert Le Demandé est en activité à Sanvic, en banlieue du Havre mais ce faïencier, qui signe ses productions du monogramme « D.R. », n’est pas verrier. L’explication proposée à la présence du monogramme sur la panse des flacons serait qu’il fut aussi négociant-verrier. Les résultats de cette recherche enrichissent d’éléments factuels l’histoire économique du Havre et de la région Normandie pour le début de l’ère industrielle. Ils illustrent les exportations « d’articles de Paris » vers Haïti à la fin de la seconde Restauration (1815-1830).This article presents the typology of the perfume bottle production discovered in the shipwreck of the French Brig Casimir. This commercial brig registered in Le Havre, sailed from France and sunk on the April 27, 1829 at 11.30pm on the northern coast of Hispaniola (Isle of Santo Domingo) (today the Dominican Republic). The morphometric study of the containers, faienceware pots and glass bottles, was forensically examined by the vibrational analysis of infra-red spectroscopy (IRTF) and its chemical analysis by the PIXE method (Particle Induced X-Ray emission) to clarify its composition. The results were used to search for the manufacturer of these glass vials and try to identify the initials “D.R.” embossed on almost all of these containers. Between 1825 and 1829, the faience factory Robert Le Demandé is the only one in activity at Sanvic, in the suburb of Le Havre. This faience-maker, which signed its productions with the monogram “D.R.”, was not a glassmaker. The explanation proposed to the presence of his badge on the bottles was that he was also dealer-glassmaker. The results of this forensic research, supported by factual elements of the economic history of Le Havre and the Normandy region in the beginning of the Industrial Age, illustrate the exports of “articles de Paris” to Haiti at the end of the second Restoration (1815-1830).Dieser Beitrag präsentiert eine Typologie von Parfümfläschchen, die im Wrack der französischen Brigg Le Casimir gefunden wurden. Der in Le Havre registrierte Handelssegler verunglückte am 27. April 1829 an der Nordküste der Insel Hispaniola, einem heute zur Dominikanischen Republik gehörenden Küstenabschnitt. Die morphometrische Analyse der Parfümfläschchen – es handelt sich um Töpfchen aus Fayence sowie aus Glas gefertigte Flakons – wird durch Ergebnisse der Infrarot-Spektroskopie sowie von chemischen Analysen nach der Methode PIXE (Particle Induced X-Ray Emission / Protoneninduzierte Röntgen-Emissions-Spektrometrie) ergänzt, die zum Ziel hatten, die Materialzusammensetzung der Gefäße genauer zu untersuchen. Die Analysenergebnisse dienten dazu, den Hersteller der Parfümflakons zu finden sowie die Initialen „D.R.“ zu identifizieren, die sich auf fast allen Gefäßen befanden. Zwischen 1825 und 1829 arbeitete ausschließlich die Fayencemanufaktur Robert Le Demandé in Sanvic bei Le Havre, aber diese Manufaktur, die ihre Produkte mit den Initialen „D.R.“ kennzeichnete, stellte keine Glasprodukte her. Die mögliche Erklärung dafür, dass sich das Monogramm auch auf dem Bauch der aus dem Wrack stammenden Glasflakons findet, ist, dass die Manufaktur Gläser zum Weiterverkauf bezog. Die Ergebnisse der hier präsentierten Untersuchungen tragen neue Erkenntnisse zur materiellen Kultur und zur Wirtschaftsgeschichte von Le Havre und der Normandie zu Beginn der frühneuzeitlichen Industrialisierung bei. Sie illustrieren die Exporte von sogenannten „Pariser Produkten“ nach Haiti am Ende der Zweiten Restauration (1815-1830).Este artículo presente la tipología del conjunto de frascos de perfumería descubierto en el resto del Casimir. Este bergantín de comercio de Le Havre (Francia) naufragio el 27 de abril 1829 en la costa septentrional de Haití (hoy situada en la República Dominicana). El estudio tipológico de los recipientes, tarros de mayólica y viales de vidrio, ha enriquecido con el análisis vibraciónal de este último por espectroscopia infrarrojos (IRTF) y su análisis químico con el método PIXE (Particle Induced X-Ray emission) a fin de precisar su composición. Los resultados se utilizan para buscar el fabricante de estos viales y tratar de identificar las iniciales “D.R.” presentes en casi todos estos recipientes. Entre 1825 y 1829, sólo la fabrica de mayólica Robert Le Demandé es en actividad a Sanvic, en el suburbio de Le Havre, pero este alfarero que signo sus producciones del Monograma “D.R.”, no es fabricante de vidrio. La explicación propuesta a la presencia de su Monograma sobre casi todos los recipientes sería que fue también comerciante-vidrio. Los resultados de esta investigación enriquecen de elementos fácticos la historia económica de Le Havre y de la región de Normandía para el comienzo de la Era industrial. Se ilustran las exportaciones “de artículos de París” a Haití al fin de la segunda Restauración (1815-1830)